Calculating the Breakdown Point of Sparse Linear Models

نویسندگان

  • Jung Jin Cho
  • Yong Chen
  • Yu Ding
چکیده

In robust statistics, the concept of breakdown point was introduced to quantify the robustness of an estimator in a linear regression model. Computing the breakdown point is useful in tuning some robust regression estimators (e.g., the least trimmed squares estimator). Computing the breakdown point for a structured linear model (i.e., one with dependencies among some p rows of the n×p design matrix X) can be very demanding. This article presents an algorithm for calculating the maximum breakdown point for sparse linear models, which are a special type of structured linear model whose design matrix has many zero entries. The algorithm decomposes a sparse design matrix into smaller submatrixes on which the computation is performed, thereby leading to substantial savings in computation. An assembly process, along with a few numerical examples, illustrate the application of the algorithm and demonstrate its computational benefits.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust Estimation in Linear Regression with Molticollinearity and Sparse Models

‎One of the factors affecting the statistical analysis of the data is the presence of outliers‎. ‎The methods which are not affected by the outliers are called robust methods‎. ‎Robust regression methods are robust estimation methods of regression model parameters in the presence of outliers‎. ‎Besides outliers‎, ‎the linear dependency of regressor variables‎, ‎which is called multicollinearity...

متن کامل

Hyperspectral Image Classification Based on the Fusion of the Features Generated by Sparse Representation Methods, Linear and Non-linear Transformations

The ability of recording the high resolution spectral signature of earth surface would be the most important feature of hyperspectral sensors. On the other hand, classification of hyperspectral imagery is known as one of the methods to extracting information from these remote sensing data sources. Despite the high potential of hyperspectral images in the information content point of view, there...

متن کامل

Sparse Structured Principal Component Analysis and Model Learning for Classification and Quality Detection of Rice Grains

In scientific and commercial fields associated with modern agriculture, the categorization of different rice types and determination of its quality is very important. Various image processing algorithms are applied in recent years to detect different agricultural products. The problem of rice classification and quality detection in this paper is presented based on model learning concepts includ...

متن کامل

Breakdown Points and Variation Exponents of Robust M-estimators in Linear Models

The breakdown point behavior of M-estimators in linear models with xed designs, arising from planned experiments or qualitative factors, is characterized. Particularly, this behavior at xed designs is quite diierent from that at designs which can be corrupted by outliers|the situation prevailing in the literature. For xed designs, the breakdown points of robust M-estimators (those with bounded ...

متن کامل

Sparse Coding of Point Cloud Data

Point clouds, made available through laser range finders, stereo cameras, or time of flight cameras, are frequently used in robot navigation systems. However, no unsupervised machine perception algorithm exists to provide understanding of the data; e.g. that a particular blob of points looks roughly like, say, a car. In this paper, we take steps towards such an algorithm based on sparse coding....

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Technometrics

دوره 51  شماره 

صفحات  -

تاریخ انتشار 2009